kishore

 

High level Summary:

·               8+ years of experience in building Data Warehouse as a Senior Datastage Designer, Senior Datastage Developer, Quality Stage Developer with consultant  roles and responsibilities.

·               Strong Knowledge of Data Warehouse Architecture which includes Star Schema, Snow flake Schema, FACT, Dimensional Tables, Physical and Logical Data Modeling.

·               Extensive knowledge and wide range of experience in Data profiling, Data cleansing, designing and developing Datastage jobs in Datastage versions 9.1, 8.7, 8.5, 8.1, 7.5 (IBM Info sphere Information Server Suite).

·               Actively participated in user / client meeting to understand and put the requirements in compatible with the ETL design on OLAP as well as OLTP systems.

·               Involved and assist the team in different phases of the project like Design, Development, Testing, Preproduction and Production.

·               Experience in gathering business requirements and preparation of software requirement specification (SRS) documents and actively participated while designing the ETL model with the architect.

·               Implement procedures for maintenance, monitoring, backup and recovery operations for the ETL environment.

·               Experience on Real time stage like XML  stages to handle web based data.

·               Infrastructure optimization, troubleshooting and debugging.

·               IBM Integration Designer is an Eclipse-based software development tool that renders your current IT assets into service components for reuse in service-oriented architecture (SOA) solutions.

·               Apply fixes, patches and Service Packs as required and provided, keeping the DS environment up-to-date. 

·               Maintain ownership of release activities which interact with ETL projects.

·               Work experience in production and support for the critical application.

·               Wide range of experience in executing projects Onsite-Offshore model.

·               Experience in creating the unit test cases, system test cases and user acceptance test cases.

·               Experience in creating the low level, high level, database design documents.

 

Design Experience:

·               Having work experience in configuring and proposing the server space and changes compatible to the project which in turn compatible for the data stage development.

·               Involved throughout the SDLC phase of a complex ETL project in Sears.

·               Created the perfect ETL structure for Sears project using extract, data quality, data transformation, data profiling and data loading methodologies.

·               Created generic ETL designs in Data stage.

·               Created Audit functionality in Datastage for validation and accretion of data while loading into tables.

·               Implemented Exception handling functionality and restart frameworks in Datastage.

·               Created the Archive and purge mechanism.

·               Experience in analyzing the existing ETL solution and proposed some changes to the existing design for the better performance.

 

Performance Handling:

·               Processed large volumes of data (more than 7 million) on a daily frequency, in form of flat files as well as from database tables.

·               Worked on the performance tuning with Datastage, SQL and the Oracle, DB2 bulk loads and simple inserts.

·               Experience in the performance tuning of the Datastage jobs for both historical migration and daily loads.

 

Datastage:

·               Extensive knowledge and wide range of experience in designing and developing Datastage jobs in Datastage versions 9.1, 8.7, 8.5, 8.1, 7.5 ( IBM Info sphere , Information Server).

·               Worked in all kinds of Datastage stages

·               Implemented SCD Type2 using Datastage

·               Implemented different functionalities in Data stage

·               Created Generic jobs, created sequences, Reusable Components(Containers) and also ran jobs from Unix

·               Good experience in Datastage Administrator, Datastage Director, Datastage Designer

·               Work experience as a Good ETL Tester

 

Quality stage:

·               Extensively used Quality stage for data cleansing.

·               Extensively used Investigate quality stage component for providing pattern and token reports to customer.

·               Extensively used standardization quality stage component to filter the cleansed data for further data transformation process.

·               Used Match Specification followed by Match Frequency Quality stage.

·               Created and edited the classifications under rule sets using Standardization Rules Designer tool.

·               Performed an unduplicate match and the reference match using match specification designer window.

 

Database:

·               Used Oracle, Teradata, Db2 connector stages extensively while reading as well as loading the data.

·               Good experience in writing SQL loader scripts and UNIX Shell Scripts to automate file manipulation and data loading procedures.

·               Experience with complex Sql scripts, Stored procedures, Creation of indexes, complex joins in Oracle

·               Experience with complex Sql scripts, Stored procedures, Creation of indexes, complex joins in DB2

·               Experience in creating the partitioned tables

·               Experience in data skews, stored procedures and CBTs  on Netezza database.

·               Experience in performance tuning of database queries on Db2,SqlServer 2012 and Oracle

 

Unix

·               Expertise in  UNIX Shell Scripting for automation of different tasks in the projects

·               Created several Unix wrapper scripts to handle the file types, FTP and file audit information

·               Created Unix scripts for productions jobs as part of production support

 

Version Mangement Tools

·               Experience in the software version configuration management tools like CVS, Star Team used for source code versioning.

 

Communication:

·               Work experience as a Team Coordinator, communicating with client, understanding the Business scenarios and implementing as part of business.

·               Highly motivated and effective team player with strong analytical and problem solving skills coupled with the ability to quickly learn and apply new technology.

 

TECHNICAL SKILLS

 

ETL Tools	Datastage 9.1,8.7,8.5,8.0,7.5 , Quality stage, Information  Services Director, Standardization rules designer ,Information Analyser.
Databases	Oracle 11g, Oracle 10g , Oracle 9i, DB2, Teradata, Netezza.
Operating Systems	AIX, LINUX, UNIX, Windows 2003 server, XP
Languages	Sql, Pl/Sql , C++
Scheduling Tools	UNIX Cron, batchman Scheduler, Datastage Scheduler,Autosys.
Certifications	Certified IBM Datastage Professional Certified IBM Qualitystage Professional

 

Education

 

Master of Computer Applications.

 

 

Certifications / Assets

 

IBM Infosphere Datastage

IBM Infosphere Qualitystage

Got many performance awards

 

 

PROFESSIONAL EXPERIENCE

 

 

NYC DOHMH, LongIsland City, NY                                Apr 2015- Till Date

DataStage and QualityStage Lead Consultant

 

Project: NYC DOHMH is continuing a project to evaluate the NY/NY III Supportive housing program by comparing and identifying individuals in supportive housing to individuals who are not by using health and administrative data sets. The Division of Informatics, Information Technology, and Telecommunications (DIITT) is to develop a probabilistic matching algorithm utilizing IBM Infosphere Quality Stage/Data Stage v9.1 to de-duplicate persons in supportive housing against multiple disparate health data sets. Need to include these data in an SQL relational data warehouse based on results of the match to link person health data across different sources.  DIITT is a multidisciplinary unit with the goal of combining cutting-edge informatics, application development analysis and reporting to implement innovative IT solutions for public health.

 

Responsibilities:

 

·               Responsible for standardizing different data sources in one common SQL table structure for de-duplication.

·               Extensively worked with IBM Info sphere Quality Stage V9.1 investigation, standardization (including CASS address verification), and Unduplicate and Reference file matching.

·               Worked to setup one-time person match using historic data, work with Informatics, Technology and Epidemiology staff to provide data sets to evaluate the algorithm and set thresholds

·               Implemented stored procedures to implement recurring matching going forward including updating the SQL Data warehouse.

·               Experience in using IBM Integration Designer(IID) to renders  current IT assets into service components for reuse in service-oriented architecture (SOA) solutions.

·               Worked with Webservices to get the data to load into the system and BPM.

·               Technical documentation of implementation.

·               Experience on web based stage like XML input,XML processing,XML output stages.

·               Worked on XML input stage to convert XML data into tabular form.

·               Performed Unit Testing, Integration Testing, Regression Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Implemented reusable components (Containers) for the error handling and error mailing.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies

·               Experience with complex Sql scripts, Stored procedures, Creation of indexes, complex joins in SQL Server2012

·               Ability to assist with operations and production coverage

·               Experience installing and upgrading Datastage Server product suite on different tiers

·               Experience with Post install Configuration, various data sources configuration for the Enterprise plug-in and configurations

·               Experience with stopping and starting server and monitor the logs.

·               Expertise with Capacity Planning for Datastage environment

·               Extensive experience with the following Create/Delete projects, create/modify environmental parameters. Multiple APT_CONFIG_FILE

·               Outstanding communication and customer support skills and experience

 

Environment: IBM Info Sphere Quality Stage and Data Stage 9.1, Flat Files, SQL Server 2012.

 

 

SEARS, Livonia, MI                                         Feb 2013- Mar 2015

Data Stage and Quality Stage Lead Consultant

 

Project: The objective of the project is to process the data from source files and Database by performing ETL to develop job streams for the interfaces, which will process data from source to target .These files are generate automated reporting capability for its client businesses. These are met by the Extraction, Transformation and Loading using Data stage.

 

Responsibilities:

·               Worked with the Business process analyst to thoroughly understand the different business processes and requirements.

·               Leading the role of onsite coordinator and handling the team.

·               Implemented Administrative tasks using Data stage Administrator

·               Creating backup of the jobs and Generation of Configuration file.

·               Creation of users and groups and Assigning roles and responsibilities to the users.

·               Documented user requirements, translated requirements into system solutions and develop implementation plan and schedule.

·               Experience on web based stage like XML input,XML processing,XML output stages.

·               Worked on XML input stage to convert XML data into tabular form and XML output stage to convert tabular to XML format.

·               Worked with BPEL (Business Process Execution Language) that allowsWeb services in a service-oriented architecture (SOA) to interconnect and share data through webservices.

·               Involved in the implementation of Clustering Architecture(Grid Technology)

·               Developed the OLTP data models for the real time retail data.

·               Developed parallel jobs between multiple source systems and sequencers.

·               Extensively worked on Information Analyzer to perform data profiling and identify and analyze the Metadata of the data (Column Analysis). Developed a detailed data profiling reports.

·               Implemented reusable components (Containers) for the error handling and error mailing.

·               Worked on Information Analyzer for column analysis, primary key analysis and foreign key analysis and developed detailed data quality assessment (DQA) reports.

·               Ability to assist with operations and production coverage.

·               Worked used Data Stage and Quality Stage Designer to develop customized rule sets for standardizing fields like individual name, organization names, address and phone numbers.

·               Extensively used Data Stage and Quality Stage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data using various stages like Standardize, Match Frequency, Reference Match, Unduplicate Match, Survive, Remove Duplicate, Surrogate Key, Aggregator, Funnel, Join, Merge, Lookup, Change Capture, Change Apply and Copy.

·               Worked with  complex Sql scripts, Stored procedures, Creation of indexes, complex joins in DB2

·               Worked with Data Stage Director to monitor and analyze performance of individual stages and run Data Stage parallel jobs and sequencers.

·               Extensively worked on migrating Data Stage jobs from development to test and to production environments.

·               Performed Unit Testing, Regression Testing, and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed parallel jobs and sequencers by using various performance tuning strategies.

 

Environment: IBM Info Sphere Data Stage 9.1/8.1, Information Analyzer, IBM AIX, Flat Files, Neteeza NPS 7.0, DB29.7.

 

WALGREENS, Detroit, MI                              Mar2011 - Jan2013

Senior ETL Lead Data Stage Developer

 

Project: The scope of the project is to develop Data Warehouse is build upon integrated legacy system data feeds received from many divisions of business data sources .Data Marts were build according to the business critical user requirements.

 

Responsibilities:

·               Involved in different phases of building the Data Marts like analyzing business requirements, ETL process design, performance enhancement, go-live activities and maintenance.

·               Interacted with the end users, Business Analysts and Architects for collecting, understating the business requirements. Documented them and translated requirements into system solutions.

·               Worked as a lead data stage developer.

·               Implemented Administrative tasks using Data stage Administrator

·               Adding Environment variables to the project and involved in the migration of data stage version from 8.5 to 9.1.

·               Maintaining the Version control of the jobs.

·               Experience on web based stage like XML input,XML processing,XML output stages.

·               Worked on XML input stage to convert XML data into tabular form.

·               Implemented reusable components (Containers) for the error handling and error mailing.

·               Designed ETL process as per the requirements and documented ETL process using MS Visio.

·               Extensively worked on Data Stage Designer, Director and Administrator.

·               Extensively used Data Stage Designer to design, develop ETL jobs for extracting data from Oracle tables and Flat files and load them into respective DataMarts.

·               Importing and Exporting of jobs through DataStage Designer into different projects.

·               Extensively worked with Fact and Dimension tables to produce source - target mappings based upon business specs.

·               Extensively worked on Information Analyzer to perform data profiling for identify and analyze the Metadata of the data (Column Analysis). Developed a detailed data profiling reports.

·               Worked on UNIX Shell Scripts to automate the file transfer process (FTP) and Scheduled jobs using AutoSys.

·               Worked with DataStage Director to monitor and analyze performance of individual stages and run DataStage jobs.

·               Experience in complex Sql scripts, Stored procedures, Creation of indexes, complex joins in Oracle

·               Implemented enhancements to the current ETL programs based on the new requirements.

·               Involved in setting up of war room sessions for the closure of issues.

·                Involved in the design of BIS architecture, Code reviews of DataStage jobs and implemented best practices in DataStage jobs.

·               Involved in up gradation of tool and migration of jobs from lower version to higher version.

·               Performed Unit Testing, Integration Testing, Regression Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies.

·               Extensively worked on coordination with Offshore.

 

Environment: IBM InfoSphere DataStage 8.5/9.1, Oracle (10g/11g), SunOS 5.1, HP Quality Center,Cognos 10, AutoSys, MS Visio, PL/SQL and Flat Files.

 

 

ALLSTATE Insurance, Fort Wayne, IN                         Jan 2010 – Feb 2011

DataStage Consultant

 

Project: The main objective of the project was to develop an Enterprise Data Warehouse for reporting and analysis purposes. Matrix extracts data from different source systems and applies business rules, loads the data into warehouse to different DataMarts and sends data to the representatives on the field.

 

Responsibilities:

·               Involved in all the phases of building the DataMarts like analyzing the business requirements, ETL process design, performance enhancement and maintenance.

·               Extensively worked on DataStage Enterprise Edition (Formerly Parallel Extender) Administrator, Designer, Director, and Manager.

·               Extensively used DataStage Designer to design, develop ETL jobs for extracting, transforming and loading the data into different DataMarts.

·               Extensively worked administration tasks like creating user profiles and assigning user privileges and creating projects for the respective releases and creating global parameters which can be commonly used across the environments.

·               Provided production support during the various phases.

·               Extensively worked on migrating DataStage jobs from development to test and to production environments.

·               Created Stored Procedures to transform the data and worked extensively in PL/SQL for various needs of the transformations while loading the data.

·               Experience in complex Sql scripts, Stored procedures, Creation of indexes, complex joins.

·               Extensively worked Requirement analysis & Impact Analysis

·               Extensively worked Designing solution framework and Data Analysis

·               Extensively coordinated with Offshore.

·               Performed Unit Testing, Integration Testing, Regression Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies.

 

Environment: IBM WebSphere DataStage 8.0 Parallel Extender, Cognos, AutoSys, Windows NT 4.0, IBM AIX 4.1, Red Hat Enterprise Linux 5, Oracle 10g,  PL/SQL, DOS and Sequential Files.

 

Ryvo Electronics, Atlanta, GA Mar 2009 –Dec 2009

PL/SQL and DataStage Developer

 

Project: The objective of the project is to develop the system, which can give him intelligent Information reports regarding his existing business situation and how he can analyze business.Involved in all the phases of building the DataMarts like analyzing the business requirements, ETL process design, performance enhancement and maintenance.

 

Responsibilities:

·               Extensively worked on DataStage Enterprise Edition 7.5.2 Administrator, Designer, Director, and Manager.

·               Extensively Worked on Parallel Extender (PX), QualityStage.

·               Extensively used DataStage Designer to design, develop ETL jobs for extracting, transforming and loading the data into different DataMarts.

·               Performed Import and Export of DataStage components and table definitions using DataStage Manager.

·               Extensively worked administration tasks like creating user profiles and assigning user privileges and creating projects for the respective releases and creating global parameters which can be commonly used across the environments.

·               Developed Stored Procedures, Functions, database Triggers and created Packages to access databases from front end screens.

·               Developed both inbound and outbound interfaces to load data into targeted database and extract data from database to flat files.

·               Extensively used Data Stage Designer to develop a variety of jobs for extracting, cleansing, transforming, integrating and loading data into target database.

·               Extracted data from various source systems like Siebel, Oracle, Flat Files and SAP R/3.

·               Extensively used SAP integration using SAP connection.

·               Created Stored Procedures to transform the data and worked extensively in PL/SQL for various needs of the transformations while loading the data.

·               Extensively worked Requirement analysis & Impact Analysis

·               Performed Unit Testing, Integration Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies.

·               Written various Unix Shell Scripts for scheduling the jobs.

 

Environment: Ascential DataStage 7.5.2 (Designer, Director, Manager, Parallel Extender) Debugger, DataStage BASIC language Expressions), Windows NT 4.0,UNIX, LINUX, Oracle 8i, PL/SQL, IBM DB2, Dbase3 Files, DOS and UNIX Sequential Files, MS Access, .csv Files, XML Files.

                      Apr 2008 – Feb 2009

THAMESWATER, Reading, UK      

DataStage and QualityStage Consultant

 

Project: The Scope of WAMI (Thames water) project is client wanted to a single view on customer data. Initially WAMI was scattered in different. They decided to create a single customer solution using SAP CRM system.

 

Responsibilities:

·               Involved in different phases of Data Integration like gathering and analyzing business requirements, ETL process design, performance enhancement, go-live activities and support.

·               Interacted with the users, Business Analysts for collecting, understating the business requirements.

·               Designed ETL process as per the requirements and documented ETL process using MS Visio.

·               Extensively worked on DataStage Enterprise Edition (Formerly Parallel Extender) Designer, Director and Administrator.

·               Extensively used DataStage Designer to design, develop ETL jobs for extracting data from different source system, transforming the legacy data to SAP ready data and loading the data into SAP system.

·               Extensively worked on administration tasks like creating projects for the respective releases and creating global parameters which can be commonly used across the environments.

·               Designed and developed DataStage jobs, containers to implement business rules.

·               Used After/ before job routines to perform specific task.

·               Involved in Master Data like Vendor Master, Customer Master and Transaction Data like AR Invoices, IM and WM managed Inventory, packing conversion.

·               Scheduled jobs using DataStage Director and Unix Shell Scripts.

·               Worked on UNIX Shell Scripts to automate the file transfer process(FTP).

·               Worked with DataStage Director to monitor and analyze performance of individual stages and run DataStage jobs.

·               Provided 24/7 support during the various test and mock phases and production support during the Go-Live.

·               Extensively worked on migrating DataStage codes from development to quality and to production environments.

·               Actively participated in discussions and implementation of Error Handling and Reject management functions.

·               Experience in monitoring the InfoSphere suite server for I/O usage, memory usage, CPU usage, network usage, storage usage.

·               Involved in setting up of war room sessions for the closure of issues.

·               Performed Unit Testing, Integration Testing, Regression Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed parallel jobs  and sequencers by using various performance tuning strategies.

·               Extensive Offshore coordination.

 

Environment: IBM WebSphere DataStage and Quality Stage 8.1 Parallel Extender, HP Quality Center, MSSQL Server 2000/2005, Sybase, SAP BW 7.0, IBM AIX 5.X, , SAP R/3, AutoSys, MS Visio, PL/SQL, DOS and Flat Files, Oracle 10g,DB2 9.7.

                    Apr 2007 – Mar 2008

Hutchinsion3G, Maidenhead, UK   

DataStage and QualityStage Consultant

 

Project: The Hutchinson 3G UK Limited business and main IT focus is now on BI – analyzing data to predict future strategies for driving business behavior, developing campaigns, and targeting clients to best effect with reliable up to date information that can help differentiate themselves in the marketplace and from their competition.

 

Responsibilities:

·               Worked with the Business analyst to thoroughly understand the different business processes and requirements.

·               Documented user requirements, translated requirements into system solutions and develop implementation plan and schedule.

·               Developed parallel jobs between multiple source systems and sequencers.

·               Extensively worked on Investigate Stage to perform data profiling and identify and analyze the data patterns and inconsistencies. Developed a detailed data profiling report.

·               Worked on Information Analyzer for column analysis, primary key analysis and foreign key analysis.

·               Extensively used DataStage and QualityStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data using various stages like Standardize, Match Frequency, Unduplicate Match, Survive, Remove Duplicate, Surrogate Key, Aggregator, Funnel, Join, Change Capture, Change Apply and Copy.

·               Worked with DataStage Director to schedule, monitor and analyze performance of individual stages and run DataStage jobs.

·               Extensively worked administration tasks like creating Repository, User groups, Users and managed users by setting up their profiles and privileges and creating global parameters which can be commonly used across the environments.

·               Designed and developed DataStage jobs to populate into the MDM and send notification in xml messages using web service transformer.

·               Written various Unix Shell Scripts for scheduling the jobs.

·               Extensively worked on migrating DataStage jobs from development to test and to production environments.

·               Involved in setting up of war room sessions for the closure of issues.

·               Designed mechanism for identifying bad records during the loading process.

·               Performed Unit Testing, Regression Testing, and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies.

 

Environment: IBM WebSphere DataStage and QualityStage 8.1 Parallel Extender, Information Analyzer, IBM MDM, IBM AIX 6.1, Oracle 10g, PL/SQL, Flat Files.

 

MetLife insurance Company, Bangalore, INDIAJan 2007 - Mar 2007

Software Developer

 

Project: The primary objective of the project is to develop  one process for their daily activities used to calculate the premium and analyze what type of policies people preferring.

 

Responsibilities:

·               Automated SQL*Loader to load the data from the flat files

·               Used Materialized Views, Packages and Dynamic SQL

·               Created programs to transform data from Legacy systems into Oracle database.

·               Worked on DataMarts using ERWIN tool.

·               Created Stored Procedures to transform the data and worked extensively in PL/SQL for various needs of the transformations while loading the data.

·               Written various Unix Shell Scripts for scheduling the jobs.

·               Implemented enhancements to the current programs based on the new requirements.

·               Experience in complex Sql scripts, stored procedures, Creation of indexes, complex joins.

·               Performed Unit Testing, Integration Testing and User Acceptance Testing (UAT) for every code change and enhancement.

·               Worked on improving the performance of the designed jobs by using various performance tuning strategies.

·               Worked closely with Business Users and Data Quality Analysts after loading data for accuracy and consistency of data.

 

Environment: MS Word, Mercury Win runner, Mercury Load runner, Windows NT 4.0, Autosys, UNIX, Knoppix Linux, Oracle 9i/8i, PL/SQL, Dbase3, DOS and UNIX Sequential Files, MS Access, ERWin, DB2/UDB/EE Database.